System and method for managing images over a communication network

ABSTRACT

A system, method, and software product for managing digital images. A server is provided for controlling access to a user image storage device having at least one digital image file of an image. The server has a communication device capable of communicating with a plurality of user computers wherein at least one of the user computers having the at least one digital image file. A software program permits automatic controlled access to the at least one digital image file on the user computer by a third party and monitors access by the third party without any further authorization by the user.

CROSS REFERENCE TO RELATED APPLICATIONS

[0001] U.S. Ser. No. ______, filed ______, entitled “METHOD AND SYSTEMFOR MANAGING IMAGES OVER A COMMUNICATION NETWORK”; Docket No. 82994/F-P;

[0002] U.S. Ser. No. ______, filed ______, entitled “A METHOD AND SYSTEMFOR MANAGING IMAGES OVER A COMMUNICATION NETWORK”; Docket No. 83009/F-P;

[0003] U.S. Ser. No. ______, filed ______, entitled “SYSTEM AND METHODFOR MANAGING IMAGES OVER A COMMUNICATION NETWORK; Docket No. 83010/F-P;

[0004] U.S. Ser. No. ______, filed ______, entitled “METHOD AND SYSTEMFOR ASSISTING IN THE RECONSTRUCTION OF AN IMAGE DATABASE OVER ACOMMUNICATION NETWORK”; Docket No. 83012/F-P;

[0005] U.S. Ser. No. ______, filed ______, entitled “METHOD AND SYSTEMFOR MANAGING IMAGES OVER A COMMUNICATION NETWORK USING USER PROVIDEDINSTRUCTIONS”; Docket No. 83013/F-P;

[0006] U.S. Ser. No. ______, filed ______, entitled “A METHOD FORMANAGING IMAGES OVER A COMMUNICATION NETWORK”; Docket No. 83014/F-P;

[0007] U.S. Ser. No. ______, filed ______, entitled “AN ELECTRONICCAMERA AND SYSTEM FOR TRANSMITTING DIGITAL OVER A COMMUNICATIONNETWORK”; Docket No. 83016/F-P.

FIELD OF THE INVENTION

[0008] The present invention is directed to automatically managingdigital image files over a communication network.

BACKGROUND OF THE INVENTION

[0009] Currently, there are many providers of online imaging services.One such example is the Kodak PhotoNet Online service offered by theEastman Kodak Company. In such a system, a user must select aphotofinishing order option on the film processing envelope thatincludes the digitization and uploading of the high resolution filmimages to a secure website where they are stored. Upon receiving andpaying for the printed photofinishing order, the user receives a couponthat includes information for accessing the digital images on thewebsite. Subsequently, the user must return to their home and using acomputer with a conventional Internet browser must navigate to thewebsite indicated by the coupon. Upon arrival at the website and entryof the supplied information, the user finally is able to view theirdigital images.

[0010] At this point, the user can electronically share their imageswith third parties. Depending on the skill of the user, they can chooseto send digitized images as image file attachments via electronic mail.This entails knowing the electronic address of those third parties whichis usually stored and managed by a different software application on theuser's computer. Furthermore, image file attachments can cause anelectronic mailbox to exceed a predetermined storage capacity especiallyif the user desires to share several images.

[0011] Another method of electronically sharing that attempts to solvethe dilemma of sharing several images involves, sending an electroniclink embedded in an electronic mail message that when clicked by thereceiver, causes the receiving computer to locate and access the websitecontaining the entire digitized order. A problem with this method isthat the receiver must have an Internet browser that is compatible withthe electronic mail application to automatically launch the internetbrowser to the site of the digitized images. Furthermore, the receivermust enter information to view the images at the site. Access must alsobe given for each and every film order processed and uploaded.

[0012] If the user desires to retrieve a copy of the digitized image foruse on their own computer, they can encounter additional problems. Forexample, the user must follow several time consuming steps that oftenincur an additional charge or fee beyond the initial photofinishingorder fee, to retrieve the high resolution image file that is stored atthe online photoservice provider. In other cases some photoserviceproviders do not allow the user to download the high resolution imagefile at all.

[0013] Another common service provided by online photoservice providersis the ability for a user to use a computer to upload a digitized imagealready in the possession of the user such as image files created by ascanner, a digital camera, or a digitized film product such as thePictureCD™ produced by the Eastman Kodak Company. These onlinephotoservice providers store high resolution image files uploaded byusers typically for producing printed images. Electronically sharing ofthese images is similar to those being placed at a website automaticallyby a photofinisher and similar problems are encountered by a user usingsuch a service. The user must, for example, take the time to upload eachand every image that he or she wishes to print or electronically share.

[0014] Another disadvantage with prior art systems is that the owner ofthe image often loses control of the high resolution image as this istypically stored at the service provider. Additionally, it is alsoundesirable to keep an entire copy of the high resolution images at aservice provider as charges are often associated with such storage. Inaddition if the service provider loses the image it can be verydifficult to regain the original high resolution image. It is thereforedesirable to be able to restore the high resolution images at the usercomputer.

[0015] In situations where the high resolution images are stored on usercomputer memory storage devices, such as a hard drive, there exists thepossibility of a memory failure with respect to the stored images. Thus,there is also a need to be able to provide a system to assist inreestablishing the high resolution images at the user computer withlittle or no cost to the user in the event of a failure of a user memorystorage device.

SUMMARY OF THE INVENTION

[0016] In accordance with one aspect of the present invention there isprovided a system for managing digital images, comprising:

[0017] a server for allowing controlled access to a user image storagedevice having at least one digital image file of an image, the serverhaving a communication system capable of communicating with a pluralityof user computers, at least one of the user computers having the atleast one digital image file, a software program for controlling accessto the at least one digital image file, the software program forpermitting automatic access to the at least one digital image file onthe user computer by a third party and monitoring access by the thirdparty without any further authorization by the user.

[0018] In accordance with another aspect of the present invention thereis provided a computer software product for managing digital imagesstored on a user computer, the software product comprising a computerreadable storage medium having a computer program which when loaded intothe user computer causes the computer to perform the following steps of:

[0019] allowing controlled access by a service provider to the digitalimage files stored on the user computer, the provider having acommunication system capable of communicating with a plurality ofdifferent devices, the software program using an electronic data filefor permitting automatic access to the at least one digital image fileby a third party and monitoring access by the third party without anyfurther authorization by the user.

[0020] In accordance with yet another aspect of the present inventionthere is provided a method for monitoring access to digital image fileson a user computer by third parties over a communication network byservice provider, comprising the steps of:

[0021] allowing controlled access by third parties to the digital imagefiles on the user computer;

[0022] monitoring access by the third parties to the digital imagefiles;

[0023] reporting the access by the third parties to the user.

[0024] In still yet another aspect of the present invention there isprovided a system for managing digital images, comprising:

[0025] a server for allowing controlled access to a user image storagedevice having at least one digital image file of an image, the serverhaving a communication system capable of communicating with a pluralityof user computers, at least one of the user computers having the atleast one digital image file, a software program for controlling accessto the at least one digital image file, the software program forpermitting automatic access to the at least one digital image file by athird party and monitoring access by the third party without any furtherauthorization by the user.

[0026] These and other aspects, objects, features and advantages of thepresent invention will be more clearly understood and appreciated from areview of the following detailed description of the preferredembodiments and appended claims and by reference to the accompanyingdrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In the detailed description of the preferred embodiments of theinvention presented below, reference is made to the accompanyingdrawings in which:

[0028]FIG. 1 is a schematic diagram of a system made in accordance withthe present invention showing the relationship of a user desiring toshare digital images with a third party as permitted by a serviceprovider;

[0029]FIG. 2 is a flow chart which shows the steps in creating a useraccount and image storage file in accordance with the invention;

[0030]FIG. 3 is a flow chart which shows the steps in automaticallysharing digital images with an authorized third party in accordance withthe invention;

[0031]FIG. 4 is a schematic diagram showing the relationship of a filmprocessing photofinisher desiring to download digitized film images witha user as permitted by a service provider;

[0032]FIG. 5 is a modified system made in accordance with the presentinvention showing the relationship of a user desiring to share digitalimages with a third party as permitted by a service provider;

[0033]FIG. 6 is a flow chart which shows the steps of the method ofoperation of the system of FIG. 5;

[0034]FIG. 7 is a flow chart which shows the steps of another method ofoperation of the system of FIG. 5;

[0035]FIG. 8 is a flow chart which shows another method of sharingimages using the system of FIG. 1 or FIG. 5;

[0036]FIG. 9 is a flow chart which shows yet another method of sharingimages using the system of FIG. 1 or FIG. 5;

[0037]FIG. 10a is partial view of a display screen illustrating an imagefrom which an image content identifier is obtained;

[0038]FIG. 10b is an enlarged view of the image content identifier ofFIG. 10a;

[0039]FIG. 11 is a flow chart of still another method of operation ofthe system of FIG. 5;

[0040]FIG. 12 is a flow chart which illustrates the process of trackingan individual low resolution image file used to produce goods and/orservices;

[0041]FIG. 13 is a chart illustrating an example of one way revenues canbe distributed among various parties;

[0042]FIG. 14 is a flow chart of a method for restoring a highresolution image on a user device;

[0043]FIG. 15 is another modified system made in accordance with thepresent invention showing the relationship of a user desiring to sharedigital images with a third party as permitted by a service provider;

[0044]FIG. 16 is a flow chart illustrating another method of operationof the systems of FIGS. 1, 5 and 15;

[0045]FIG. 17 is a screen shot of a display screen showing an image andan electronic instruction/order form.

[0046]FIG. 18 is a flow chart illustrating another method of operationof the systems of FIGS. 1, 5 and 15;

[0047]FIG. 19 is a block diagram of an electronic camera 23;

[0048]FIG. 20 depicts a rear view of the electronic camera incorporatingthe features of FIG. 19;

[0049]FIG. 21 is a flow chart of a method of using the electronic cameraof FIG. 20;

[0050]FIG. 22 shows a flow chart that illustrates another method ofoperation of the system of FIG. 1; and

[0051]FIG. 23 illustrates a flow chart which shows another method ofoperation of the system of FIG. 1

DETAILED DESCRIPTION OF THE INVENTION

[0052] Referring to FIG. 1, there is illustrated a system 18 made inaccordance with the present invention. System 18 includes a usercomputer 10 operably connected through a communication service provider(CSP) 20 and a communication network 50 (such as the Internet) to aservice provider 80. Also included in system 18 is a third partycomputer 16 operably connected to the communication network 50 andservice provider 80 via a CSP 22. User computer 10 is also operablyconnected to an electronic camera 12 and a storage drive 14. Theelectronic camera 12 can be a digital still camera such as the KodakDC280 digital camera manufactured by the Eastman Kodak Company or it canbe a digital motion camera such as the Kodak MC3 portable multimediadevice which records motion and sound in addition to still capture andsound reproduction. For the simplification of discussion, digital imagesoriginally created by either digital still, digital motion electroniccameras, or by scanning film, will be referred to as high resolutionimage files. Likewise, low resolution files are formed from the highresolution image files by sub-sampling, which in the case of digitalstill image files, involves reducing the number of image pixels andeffectively lowering the resolution. Such low-resolution, or “thumbnail”size images, can be created as described in commonly-assigned U.S. Pat.No. 5,164,831 “ELECTRONIC STILL CAMERA PROVIDING MULTI-FORMAT STORAGE OFFULL AND REDUCED RESOLUTION IMAGES” to Kuchta, et. al., the disclosureof which is herein incorporated by reference. In the case of digitalmotion files, low resolution files can include the discarding of framesand/or pixels within a frame. Such techniques are well known in the artand facilitate the transportation of images across any communicationnetwork 50 such as the Internet.

[0053] In the particular embodiment illustrated, the storage drive 14 isillustrated as being removable. However the present invention is notlimited to such a configuration. For example, the storage drive 14 canbe an integral part of user computer 10 and can use removable storagemedia (not shown). The electronic camera 12 can connect to the usercomputer 10 via a cable employing a common interface such as a UniversalSerial Bus (USB) interface. Alternatively, electronic camera 12 canconnect to the user computer 10 in a wireless mode employing any numberof conventional interfaces such as the radio frequency standard commonlydescribed by Bluetooth™ Specification V1.0 or Wireless Personal AreaNetwork IEEE Standard 802.15. Likewise, removable storage drive 14 isoperably connected to user computer 10 and permits the storage of highresolution image files such as digital still or digital motion imagesand associated metadata that can, for example, further include audioinformation. For the purposes of the present invention, an image mediafile includes a digital image file (high or low resolution) and can alsoinclude additional data such as associated audio or metadata. The userselects the location for the storage of the high resolution image mediafiles either internally to the user computer 10 or on removable storagedrive 14, such as computer disc, CD, etc. In general, high resolutionimage media files can be arranged in a user storage file such as adatabase.

[0054] The user computer 10 is provided with appropriate software forallowing controlled access to a high resolution image media collection,such as a database, stored on memory storage device 14. The highresolution image media collection comprises at least one high resolutionimage media file and as previously discussed can include associateddigital data. A low resolution copy of each high resolution digitalimage file along with any associated meta data/information (thecombination of both files hereinafter referred to as the user lowresolution image collection) is electronically sent to the serviceprovider 80 for storage at the service provider 80 and is associatedwith the user. One way in which an image can be associated with a useris the addition of metadata to the image media files(s) that reflects aspecific user identifier such as a user account number, a user providedidentifier with any combination of alphanumeric characters, or any otherconstruct in the form of metadata. Another form of association with theuser can be accomplished by creating a storage system that allocatesfile storage based on a user identifier such as a relational database.This association creates a low resolution user image collection of thedigital image files at the service provider 80. While the digital imagefiles and associated data files can be forwarded by the user, thesefiles can be automatically retrieved by the service provider 80. Forexample, the user has a database identified for access by the serviceprovider 80. The service provider 80 can automatically, on a routineschedule, determine if the user computer 10 is available over thecommunication network 50. If the user computer 10 is available forcommunication, the service provider 80 will then automatically reviewthe database on the user computer 10 where the high resolution mediafiles are stored to determine if any new digital image files orassociated files have been added to the database. If new files have beenadded or changed, then a low resolution image file is formed for eachnew image and data changes are appropriately communicated to the serviceprovider 80 for storage and association with the user low resolutionimage collection.

[0055] As previously discussed, in addition to the low resolution imagesstored at the service provider 80, there can be stored various otherdata/information related to these images. This information can be usedto identify who can have access to the low resolution image andinformation that describes the content of the images. In addition, thisinformation can include information relating to the data storagestructure of the high resolution images stored on image storage device14. The data storage structure information includes parameters thatreflect the storage locations of the high resolution image media fileson the physical media such as track and sector information associatedwith hard disk memory architecture. This information can be used toassist in the rebuilding of a damaged directory in the event of afailure of storage device 14 and can be automatically updated on aroutine communication interval by the service provider 80. Oftentimes,damaged directories on hard disks can render a disk drive unreadablewhen the actual file data is still valid. Software running on the usercomputer 10 such as the commercially available Norton Utilities offeredby Symantec Inc. can restore the accessibility of high resolution imagemedia files using the data storage structure information related to thelow resolution image media files stored by service provider 80 as laterdiscussed herein with respect to FIG. 14. Service provider 80 canprovide this additional service for a fixed or recurring fee. This canprovide valuable assistance in reconstructing damaged digital imagefiles on user computer 10.

[0056] Further information can be provided to the service provider 80for assisting in identifying content of the images and/or individualsthat can have access to the images. For example, an image icon 202, suchas illustrated in FIG. 10b can be used as a content identifier to firstidentify content of images forwarded to the service provider 80. In theembodiment illustrated, the image icon 202 is in the form of the face ofan individual taken from image 206 of FIG. 10a. Thus face recognitionsoftware programs, such as described in co-pending U.S. pending patentapplication entitled A METHOD AND SYSTEM FOR CATALOGING IMAGES, of JohnR. Squilla and Dale Fredrick McIntyre, Ser. No. 09/640,938, filed Aug.17, 2000 which is hereby incorporated in its entirety by reference, canbe used to review the images to be forwarded and identify the imageswith such content identifiers. When such images are identified, theidentification information is recorded as metadata and stored inassociation with that image. The identification information can be usedto identify who can view this image at the service provider 80 or evenprovide an automatic forwarding of the image to a specified individual.While the images can be automatically analyzed for such information, theuser can also specify that a particular icon 202 be associated with aparticular image.

[0057] While the icon 202 has been shown for use in identifying otherindividuals found within digital images to which said images are to beforwarded, the present invention is not so limited. The icon 202 canalso be used to identify images that the user wishes to be sent to him.For example, the icon 202 can represent the face of the user and thatwhen the icon 202 is sent to a third party it can be used to identifyimages that include the user. The icon 202 can also be provided withinformation, such as a Universal Resource Locator (URL) address, wherethe image is to be sent. The icon 202 can be sent to specific thirdparties wherein the third party would provide consent to have theirimages reviewed for forwarding to the user who provides the icon 202.The service provider 80, upon request from the user providing the icon202, can search the low resolution image collections of other users foroccurrences of the icon 202 applied to their images. Upon finding imagesof other users that have applied the icon 202 of the user providing theicon 202, service provider 80 can automatically forward these images tothe user providing the icon 202. Furthermore, service provider 80 keepsa log or record of the other users who have used the icon 202 providedby the user. Thus the service provider can monitor access and/or use ofdigital media files associated with the icon 202. When the user updatestheir icon 202, for example, when their appearance changes due to aging,modifications to hair style or color, modifications to facial hair etc.,service provider 80 automatically updates the icon 202 for those usersfound in the log associated with the use of the specific updated icon202. The updated icon 202 can replace the existing icon 202 or it can besimply added to the database of icons 202. Allowing the two icons 202 tocoexist permits the recognition of high resolution image files that canbe scanned and provided at a substantially later date. The icon 202 canalso be used to access public sites that have images that can be usedfreely or for a price. While the icon 202 has been described asrecognizing images containing a particular individual, the icon 202 canrepresent any theme, for example, any sports, hobby, or item. Imagesthat have been identified with any such theme can be automaticallyforwarded by service provider 80 to the image collection of a specialinterest group that a user may belong to. Such preferences forforwarding are stored at service provider 80 as previously discussed.

[0058] Further information such as loyalty points can be associated withthe user by the service provider 80 in response to interactions with thesystem 18 or the system 200 (FIG. 5). For the purpose of the presentinvention, loyalty points shall be considered discounts, credits orother value assessed on behalf of the user which are credited toward thepurchase or sale of goods and/or services. For example, a user whoshares at least one of the low resolution image media files with anauthorized third party, can earn loyalty points from service provider80, if the authorized third party orders image based goods and/orservices from service provider 80 that are derived from the shared lowresolution image media files. Service provider 80 can award more pointsto a user who shares with an authorized third party that doesn'tcurrently have an existing relationship with service provider 80.Incentives, in this case, are placed on encouraging additional users todevelop relationships with service provider 80. To award loyalty points,service provider 80 can maintain a log or record of all accesses toimages maintained in a user's image collection. This arrangement has theadded benefit of providing a tracking mechanism in the event that anauthorized third party misuses an image file provided by a user. Loyaltypoints can be redeemed at service provider 80 or fulfillment provider 70for image related goods and/or services. See FIG. 12 for a more completedescription of this operation.

[0059] Another process of earning loyalty points will be discussed laterwith respect to FIG. 18 and can include authorized third partiesperforming extended services such as cataloging by matching the user'scontent identifiers to the user's digital images to be cataloged.Rewarding an authorized third party with loyalty points for matching theuser's content identifiers to the user's images relieves serviceprovider 80 from the image processing burden.

[0060] Service provider 80 includes a server 82 for interfacing with thecommunications network 50 such as the Internet or a virtual privatenetwork (VPN). In addition to interfacing to the communications network50, server 82 transfers information to computer system 86 which managesinformation associated with various users. Computer system 86 includesan account manager 84 which is software operating in accordance with theinvention to permit the creation and management of individual useraccounts. Information associated with user accounts is stored inrelational database(s) 88. User account information includes personalinformation such as name and address, billing information such as creditcard information, network information such as personal electroniclocation information and authorization information which controls accessto the user's images by third parties. Also associated with useraccounts are relational database(s) 88 which store low resolution userimage files, related metadata and other information relevant toproviding services to the user. One such example, but not by way oflimitation, is a defect and directory map of the user's physical storagedevice to aid in the recovery of damaged image media files stored on thestorage device 14.

[0061] Also shown in FIG. 1 is fulfillment provider 70 which providesimage-based goods and/or services to users and third parties.Fulfillment provider 70 includes a fulfillment web server 72, a digitalprinter 78 and a fulfillment computer system 76 that further includes acommerce manager 74 and a fulfillment manager 75. Fulfillment requestsreceived from service provider 80, user computer 10 or third partycomputer 16 are handled by commerce manager 74 initially before handingthe requests off to the fulfillment manager 75. The fulfillment manager75 determines which equipment is used to fulfill the ordered good(s)such as a digital printer 78. After fulfillment, the ordered goods arereturned to the ordering party by a delivery means for example, but notby way of limitation, a transportation vehicle 68.

[0062] In order to better understand the present invention, adescription of the operation of the system 18 will be discussed. FIG. 2is a flow chart of the operation of the system 18. In the first step 30,the user establishes an account with the service provider 80. As a partof establishing an account, various information is provided, forexample, but not limited to, name, address, electronic address, creditcard information, names of individuals or business establishments thathave permission to access image media files, names of any particularfiles of grouped images and authorized viewer, the type of accessgranted, name of a preferred fulfillment service provider for theproviding of goods and/or services and automatic forwarding instructionsper selected criteria. It is of course to be understood that any otherrelevant information and/or instructions can be provided as desired orthat which the service provider is cable of providing. In the next step32, the user identifies or establishes the high resolution mediacollection. In the next step 34, low resolution digital image files areformed from the high resolution digital image files in the collectionand are forwarded to the service provider 80 along with any appropriateassociated data files (user low resolution image collection) over thecommunication network 50. At the next step 36, the verification that theservice provider 80 has received the low resolution media files iscompleted. If the transfer of the low resolution media collection wasnot successful, the user is advised of this non-successful transmissionin step 38 and repeats the transmission of the low resolution mediacollection in step 34 until successful. Upon successful receipt of thelow resolution media collection, the service provider 80 at step 40creates a low resolution media collection where these low resolutionmedia collections are stored and associated with the user.

[0063] Referring to FIG. 3, there is illustrated a flow chart of one wayin which the media files stored at the service provider 80 can be used.In step 40, the instructions previously provided by the user arereviewed and implemented. For example, if a third party has beendesignated to automatically receive selected media files as identified,these media files will be forwarded over the communication network 50 tothe designated third party at step 42. As illustrated by FIG. 1, thiscan be a third party computer 16. Alternatively, the selected mediafiles can be forwarded to a fulfillment provider 70 location forfulfillment of a service or product, such as producing a print fordelivering to a designated individual from a fulfillment provider 70.While the fulfillment provider 70 can use the low resolution media filefor the fulfilling of the requested goods and/or services, often, thefulfillment provider 70 needs the high resolution digital image. In suchcase, the provider 80 can directly access the high resolution filesdirectly from the user or have them provided through the serviceprovider 80. Typically the fulfillment provider 70 comprises a facilityfor printing or producing images from digital media files that have beenprovided by users and delivering them to designated locations. However,the fulfillment provider 70 can deliver any goods or services that theyare capable of providing. For example, but not by way of limitation, thegoods can include T-shirts, mugs, cakes, or any other goods or servicesthat incorporate images provided by the user.

[0064] In another form of the present invention, at step 44 a thirdparty can access the low resolution image collection over thecommunication network 50 using third party computer 16. Optionally inStep 46, the service provider 80 can produce and transmit a report tothe user that monitor the details of which media files were shared oraccessed by which third parties.

[0065] Turning now to FIG. 4, there is illustrated a flow chartrepresenting a process used by service provider 80 for automaticallyupdating the low resolution image collection associated with a userduring a regular and periodic update or replication procedure. At anagreed upon routine communication interval, service provider 80establishes a connection with user computer 10 (step 52). The connectioncan either be established by the user computer 10 initiatingcommunication or by the service provider 80 initiating thecommunication. The service provider 80 then checks to see if the highresolution image collection has been modified (step 54). Modificationsto the high resolution image collection can include the addition ormodification of at least one image media file, additions and/ormodifications to metadata, modifications to the user account informationsuch as the addition or deletion of authorized third parties, or anyother desired changes to the user account information. Once thisinformation has been obtained, service provider 80 makes the appropriatechanges (step 56) to the user account and/or low resolution imagecollection. Relational database(s) 88 are updated with the updatedinformation. If no modifications to the high resolution image collectionare detected (step 54), the service provider 80 concludes thecommunication in step 58.

[0066] Turning now to FIG. 5, there is illustrated a modified system 200made in accordance with the present invention. System 200 is similar tosystem 18 with like numerals indicating like parts and operation aspreviously discussed. In system 200, a photofinisher 90 is provided forprocessing of photographic film 92. It should be noted that thephotofinisher 90 can be a retail establishment by itself or operating inassociation with a wholesale photofinishing establishment. In theparticular embodiment illustrated, the photofinisher 90 includes a filmprocessor 94 for developing of the images on photographic film 92. Afilm scanner 96 is provided for scanning of images formed on theprocessed film for obtaining high resolution digital image files thatare forwarded to a memory device 98 as high resolution image files. Thephotofinisher 90 also includes an appropriate computer 100 for managingof the various equipment and various operations of the photofinishingsystem. One such operation is the attachment of metadata to the highresolution image file that identifies the specific photofinisher via apre-assigned unique business identifier. In the case where thephotofinisher 90 is a wholesale photofinisher operating in associationwith a retailer, separate business identifiers are attached as metadatato the high resolution image media files linking both wholesalephotofinisher and retailer to the specific photographic film 92 and theprocessed images associated therewith. Another operation of computer 100is the providing of information to a server 102 for communicating overthe communication network 50 to various third parties. The photofinisher90 also includes an appropriate printer 104 for printing of images thathave been scanned onto an appropriate media, for example, photographicpaper, thermal media, etc. It is, of course, understood that any otherappropriate output device can be provided for producing prints or otherproducts incorporating images that have been obtained from the scanningof the developed photographic film 92.

[0067] Referring to FIG. 6, there is illustrated a flow chart of onemethod of the operation of the system 200 of FIG. 5. A roll of exposed,undeveloped photographic film 92 provided, for example, in a filmcartridge 93 is forwarded to the photofinisher 90 (Step 106) inassociation with the user. In the next step 108, the photofinisher 90develops the film 92 and scans the developed images for producing highresolution image files that are temporarily stored on memory device 98with metadata identifying the photofinisher 90 as the retailer orseparably as the retailer and photofinisher as discussed earlier. Thephotofinisher 90, in the embodiment illustrated, further associates anunique identification (ID) 110 that is provided on the film 92 with thescanned images and hence, the high resolution image files. Such anunique ID 110 can also be attached to a user order in a variety of ways.For example, but not by way of limitation, the unique ID 110 can beassociated with a photofinishing envelope (not shown), the filmcartridge 93, pre-exposed on the film 92 itself, by random assignment,or any other appropriate way to associate the film 92 and the user.Unique ID 110 can be appended as metadata to the high resolution imagemedia file upon scanning to associate the digital image with the user.Commercially available film products manufactured by the Eastman KodakCompany under the Advantix™ brand are examples of film cartridges 93having the unique ID 110 associated with them.

[0068] Continuing on with FIG. 6, these high resolution media files andunique ID 110 are transferred via communication network 50 to theservice provider 80 in association with the user at an appropriate time(step 112). Following receipt of the high resolution media files,service provider 80 (step 114) checks to see if the unique ID 110 hasbeen registered with specific processing instructions. A more completedescription on one method of registering film with a service providercan be found in co-pending U.S. patent application entitled A Kit ForOrganizing A Plurality Of Images, Ser. No. 09/470,938, filed Dec. 22,1999 by Dale Fredrick McIntyre and Joseph Anthony Manico which is herebyincorporated in its entirety. If the photographic film 92 is notregistered, service provider 80 creates low resolution copies of each ofthe newly received high resolution files in step 118. These lowresolution copies are then added to the user's existing low resolutionimage collection in step 120. The high resolution files are temporarilystored at the service provider 80 until they are transferred to theuser's high resolution image collection on the user computer 10 at thenext routine communication interval or non-scheduled communication (step122). In an alternate embodiment of steps 118, 120 and 122, serviceprovider 80 can store the high resolution image files for an orderingperiod that makes ordering of image goods and/or services by the user orauthorized third parties more convenient. The storing of the highresolution image files for the ordering period is in addition totransferring the high resolution files to the user computer 10. Afterthe expiration of the ordering period, the high resolution image filesare automatically converted to low resolution copies and added to theuser's low resolution image collection. This would be particularlyuseful to a service provider, in that, initial interest in obtainingprints or other image products/services usually occurs in a relativelyshort time after obtaining the image. Thus, making the need to obtainthe high resolution file from user computer 10 unnecessary during thisordering period.

[0069] If the photographic film 92 is registered, instructionsassociated with the registration are carried out by the service provider80 in step 116. These instructions can include for example, but not byway of limitation, the directions to print, automatically transmit tovarious third parties and deliver various image-based goods and/orservices to the user or third parties designated in the instructions.Third parties that have similar arrangements for low resolution imagemedia collections maintained by service provider 80 will receive theautomatically transmitted low resolution image media files as additionsto their low resolution image media collections. At the next routinecommunication interval for these third parties, these low resolutionimage media files are automatically transferred to the third parties'computers 16. Software running on each third party computer 16 causesnewly transferred image media files to be presented to the third partywithout needing to use the process of attaching/detaching operationsfound in traditional electronic mail protocols. This process will bediscussed in further detail with respect to FIG. 11 later in thisspecification.

[0070] After completing the registered instructions, service provider 80creates low resolution copies of each of the newly received highresolution image files in step 118. These low resolution copies are thenadded to the user's existing low resolution image collection in step120. The high resolution image files are temporarily stored at theservice provider 80 until they are transferred to the user's highresolution image collection on the user computer 10 at the next routinecommunication interval. It is of course to be understood that anyassociated digital files can also be communicated to user computer 10.

[0071] Another method of operating the system 200 is shown as a flowchart in FIG. 7. In this embodiment, photographic film 92 associatedwith the user is forwarded to the photofinisher 90 in step 124. Thephotofinisher 90 in step 126 processes the photographic film 92, readsthe unique ID 110, scans the developed film images, forms highresolution image files and temporarily stores them in memory device 98associated with the user and the photofinisher 90 as discussed earlier.In step 128, photofinisher 90 establishes a communication connection viacommunication network 50 to service provider 80 and passes the unique ID110 to service provider 80 to see if the photographic film 92 has beenregistered and has instructions pertaining to the ordering of imagerelated goods and/or services. If the photographic film 92 had beenregistered, photofinisher 90 carries out the instructions (step 130)which can by way of example, but not limitation, include printingadditional copies of the high resolution image media files to beforwarded to a third party via delivery vehicle 68.

[0072] If the photofinisher 90 has been determined to be an authorizedthird party in step 132, the photofinisher 90 can transfer (step 134)the high resolution image files from the memory device 98 to the usercomputer 10. The updated high resolution media image collection on usercomputer 10 will be detected and the appropriate low resolution imagefiles formed and transferred to the low resolution image mediacollection maintained by service provider 80 at the next routinecommunication interval. At this point, the photofinisher 90 reaches theconclusion of the activity in step 136.

[0073] If the photofinisher 90 is not an authorized third party (step132), photofinisher 90 transfers the high resolution digital image filesto the service provider 80 (step 138). The service provider 80 thencreates low resolution image file copies of each high resolution digitalimage file (step 140), adds them to the low resolution image mediacollection associated with the user (step 142) and transfers the highresolution digital image files to the user computer 10 (step 144) at thenext communication. Optionally, after step 138, service provider 80 canadditionally implement the steps marked at point “A” illustrated in FIG.9 to the conclusion of that flow chart. These additional steps, as shownby FIG. 9, compare the newly digitized and transferred high resolutionimage files with the content identifiers for the automatic routing ofand adding information to form image media files based on identifiedcontent within the high resolution image files.

[0074] The flow chart of FIG. 8 shows another method for sharing of themedia collection wherein the user has provided information regarding thecontent of the files to be shared using software operable on usercomputer 10. The information has been stored as metadata associated withthe image file within the high resolution image media collection on theuser computer 10 or storage drive 14. In step 148, a connection isautomatically established between service provider 80 and the usercomputer 10. Optional step 149 reflects system 200 permitting the userto turn “on” or “off” the feature of automatically routing an imagemedia file to a third party. If the autoroute feature is turned off, therest of this flow chart doesn't apply, ending the process in step 162.

[0075] Continuing at step 150, service provider 80 determines if a newmedia file has been added to the high resolution image media collectionon the user computer 10. Upon finding new high resolution image mediafiles, service provider 80 examines the metadata associated with the newhigh resolution image media file for specific sharing metadata at step152. For example, a high resolution image media file that is a stillimage of “John” has been annotated by the user as “John”. In the user'ssupplied account information with service provider 80, “John” has beencorrelated to an electronic mail address as john.doe@service.com.Sharing this image media file (step 158) causes an electronic mailmessage to be generated and forwarded to john.doe@service.com.Alternatively, “John” also has an account and low resolution image mediacollection with service provider 80. Sharing (step 158) in thisalternative example, is accomplished by a direct file transfer from thelow resolution image media collection of the user to the low resolutionimage media collection of “John”. Intermediate steps 154 and 156, allowservice provider 80 to aggregate multiple image media files to be sharedwith the same third party. After sharing the image media files inaccordance with the examined metadata, the new image media files withinthe high resolution image media collection are updated (step 160) withthe metadata of which third party they were shared with.

[0076] Turning now to FIG. 9, another method for the sharing of andadding non-image information to image media files is shown as a flowchart wherein system 200 analyzes the content of the image media filesand automatically shares those image media files with authorized thirdparties in accordance with instructions stored at service provider 80 inassociation with the user. System 200 additionally stores informationassociated with recognized content as metadata with the image mediafiles. Beginning with connecting to user computer 10 in step 166, system200 checks the high resolution image media collection for new addedfiles (step 168). If no new files have been added, the current processends in step 184. Upon finding new files (step 168), the computer system86 of service provider 80 loads user content identifiers (step 170) fromrelational databases 88 associated with the user. Continuing on withstep 172, computer system 86 processes the newly added files against theuser content identifiers in accordance with the aforementioned US patentapplication of John R. Squilla and Dale Fredrick McIntyre, Ser. No.09/640,938, previously discussed. The processed high resolution imagefiles with recognized content have metadata appended to them asdetermined by the content identifiers. Steps 174, 176 and 178iteratively examine the processed image files for recognized content,add the information associated with the recognized content as metadataand create a sharing image media file that can include a plurality ofthe processed image files to be shared with a single third party. Thesharing file is sent to a third party identified by the associatedcontent identifier in step 180 following which, the image files have“sent to” metadata stored in association with the specific image file(step 182) both in the low resolution image media collection stored atthe service provider 80 and the high resolution image media collectionstored in the user computer 10 or storage device 14.

[0077]FIG. 10 is a partial view of the display screen 204 of usercomputer 10 wherein a representative image 206 of the high resolutionimage media file is displayed. Dotted line “L” indicates selected imagecontent identifier and results from an action taken by software runningon the user computer 10 in response to a user acting with a selectiondevice such as a computer mouse or in response to an algorithm foridentifying content. The selected image content identifier forms theimage icon 202 as shown by FIG. 10b which is a form of contentidentifier.

[0078] Turning now to FIG. 11, there is illustrated a flow chart foroperating another aspect of system 18 and modified system 200. Beginningin step 250, service provider 80 establishes a connection with thirdparty computer 16 over communication network 50 for the purposes oftransferring low resolution image media files sent to the third party bythe user. After establishing a working connection, service provider 80downloads the low resolution image media files to third party computer16 (step 252) which detects the newly shared low resolution image mediafiles, (step 254) and launches a low resolution image media file browsersuch as standard slide show software (step 256) thus eliminating theneed to detach an image media file from an e-mail message and launch animage viewing application.

[0079] Turning now to FIG. 12, a flow chart illustrates the process oftracking an individual low resolution image media file associated with auser when it is used by an authorized third party for producing imagebased goods and/or services and awarding loyalty points to the user.Beginning with step 228, an authorized third party places an order forimage based goods and/or services with service provider 80 based on alow resolution image media file shared by the user. The authorized thirdparty also provides a form of electronic payment such as a credit cardto service provider 80 in a manner well understood in the art forelectronic commerce transactions. Service provider 80 needs the highresolution image media file to forward to fulfillment provider 70. Instep 230, service provider 80 determines the user who shared the lowresolution image media file that the third party is using to place animage based order. This can be accomplished by looking at the metadataassociated with the low resolution image media file as discussedearlier.

[0080] Continuing with step 232, the service provider 80 determines ifthe user computer 10 associated with the low resolution image media fileis connected to the communication network 50. If user computer 10 is notavailable, the service provider 80 places a request (step 242) for theassociated high resolution image media file with the account manager 84for retrieval at the next routine communication interval indicated bythe dotted line “M”. Optionally, service provider 80 can send an e-mailmessage to the user to alert him/her that a high resolution image mediafile is required to fulfill an order. In yet another method ofnotification, service provider 80 can send an automated phone message tothe user instructing him/her to make user computer 10 available. Whenthe user computer 10 is operably connected to the communication network50, the associated high resolution image media file is retrieved andforwarded to the fulfillment provider 70 in step 234. The user's accountis then updated with loyalty points (step 236) assigned as a result ofthe transaction of the third party. The loyalty points can be assignedas a function of a dynamic look-up table managed by service provider 80.For example, a 4×6 hard copy print might earn 10 loyalty points, analbum page 100 points and a Compact Disc (CD) 200 points and so on andso forth for other goods and/or services that can be offered by serviceprovider 80 or fulfillment provider 70. The loyalty points can bedynamically adjusted by the service provider 80 in response to marketconditions or levels of user orders. Similarly, new products might beoffered with a temporary higher level of loyalty points to encouragetheir trial and use.

[0081] Fulfillment provider 70 completes the order placed by the thirdparty and delivers the image based goods and/or services in step 238. Ifthe third party has a similar arrangement for a low resolution imagemedia file collection with service provider 80, account manager 84assigns loyalty points (step 240) to the account of the third partybased on this order. At the completion of the order, service provider 80distributes revenues (step 244) collected from the third party to thoseproviders associated with the developing, scanning, processing, printingetc. where such providers have contributed to the production of theordered goods and/or services. An example of revenue distributionamongst various contributing providers is illustrated in the table ofFIG. 13. If the service provider 80 also completes the fulfillment ofthe ordered goods, then the service provider 80 earns the designatedpercentage “D” that would normally have been distributed to fulfillmentprovider 70. A retail store, for example, could process, print and scannegatives earning the combined designated percentages of “B” and “C” ofthe revenue collected by service provider 80. It is of course to beunderstood that the amount of percentages can be any desired value.

[0082] Turning now to FIG. 14, there is illustrated a process forrestoring data structure information for high resolution image filesstored on storage device 14 in the event of a user device malfunction.Beginning in step 260, the user has received a disk read error whiletrying to view or otherwise use an image from the high resolution imagemedia collection stored on storage device 14. Setting a disk driveservice flag (step 262), the user is asked (step 264) by softwarerunning on the user computer 10, if they desire to back up the highresolution image collection onto removable storage media prior toservicing the malfunctioning disk drive. The user optionally can choose(step 266) to back up the high resolution image media collection at homeonto a storage device operably connected to user computer 10 or viaservice provider 80 uploading all of the high resolution image filesthat weren't previously backed up. In step 272, the user has chosen toback up the high resolution image media files at home whereby softwarerunning on user computer 10 causes the appropriate high resolution imagemedia files to be written to removable storage media supplied by theuser. If backing up the high resolution image media files at home is notpossible, then the user can request service provider 80 to perform thistask in exchange for a service fee. At a convenient time, serviceprovider 80 uploads (step 268) all the high resolution image media filesnot previously backed up. Continuing with step 270, service provider 80writes the uploaded high resolution image media files to an appropriateremovable media which was previously agreed to by the user. Aftercompleting the writing and verifying of high resolution image mediafiles, service provider 80 causes the written removable media to be sentto the user and deletes (step 270) the uploaded high resolution imagemedia files. Of course, the user can choose to pay an additional fee andkeep all the high resolution image media files stored at serviceprovider 80. Following the completion of backing up high resolutionimage media files, service provider 80 downloads (step 274) data storageparameters to the user computer 10 which are updated at eachcommunication or on a periodic basis. Finally in step 276, softwarerunning on the user computer 10 uses the data storage parameters torestore the integrity of the storage device 14.

[0083] Turning now to FIG. 15, there is illustrated another modifiedsystem 300 made in accordance with the present invention. System 300 issimilar to system 18 with like numerals indicating like parts andoperation as previously discussed. In system 300, user computer 10permits the storage of high resolution image media files provided from anumber of image media file sources on storage device 14. High resolutionimage media files can be provided by photofinisher 90, as previouslydiscussed, which provides high resolution image media files associatedwith the user to service provider 80 for eventual transferring to theuser computer 10. There are many other ways in which image media filesassociated with the user can be provided to service provider 80 fortransfer to the user computer 10. For example, high resolution imagemedia files captured by a cellular wireless electronic (digital) camera23 can be transferred to service provider 80 through a commontelecommunications network 25, as described in commonly-assigned U.S.patent application Ser. No. 09/718,018, (Docket 81,086P/F-P continuationfiled Nov. 20, 2000) “SYSTEM AND CAMERA FOR TRANSFERRING DIGITAL IMAGESTO A SERVICE PROVIDER” filed by Endsley, et. al., the disclosure ofwhich is herein incorporated by reference. Each transfer through thetelecommunications network 25 can generate a transfer fee to be chargedto the user through service provider 80. Furthermore, service provider80 can process the high resolution image media file from the cellularwireless electronic camera 23 with respect to content identifiersassociated with the user as previously discussed with respect to FIGS.1, 10a and 10 b. Upon matching image content of the transmitted highresolution media file with the users content identifiers, serviceprovider 80 can send a return message to the cellular wireless camera 23prompting the user to verify the content identified by service provider80. The verification prompt message can be displayed on the color LCDimage display 332 and the user operating push buttons 372-376 shown inFIG. 19 can respond to validate or invalidate the identified content.Such validation is advantageous while the user has just captured theimage and his memory of the image content is still fresh.

[0084] Another example in which image media files associated with theuser can be provided to service provider 80 for transfer to the usercomputer 10 is a kiosk 15 such as the Kodak Picture Maker™ kiosk thatincludes a scanner for producing a high resolution image media file of ahardcopy print. Connected to the communications network 50, the kiosk 15can, for a fee, provide high resolution image media files to serviceprovider 80 that are eventually transferred to the user computer 10.

[0085] In FIG. 16, a process for operating the systems 18, 200 and 300is shown which permits the user to request an extended service inassociation with a particular high resolution image media file.Beginning in step 280, the user electronically tags (identifies) a highresolution image media file with an extended service indicia. Theextended service indicia causes software running on the user computer 10to retrieve an electronic form (See FIG. 17) that is associated with therequested extended service. The electronic form can be stored on theuser computer 10 as part of a service agreement with service provider 80or it can be actively retrieved from the service provider 80. In eithercase, the electronic form is retrieved and filled out (step 282) by theuser. Upon establishing communication (step 284) either immediately orat the routine communication interval, service provider 80 determines(step 286) if any extended services have been requested. If not, serviceprovider 80 completes the typical processing done at the routinecommunication interval (step 288) as has been previously discussedending the process in step 294. If extended services have beenrequested, service provider 80 uploads (step 290) the completedelectronic form associated with the high resolution image media file.Following this step, service provider 80 executes (step 292) theextended service request as indicated by the instructions on theelectronic form shown in FIG. 17, with the process ending in step 294.

[0086] Turning now to FIG. 17, a screen shot 310 of user computer 10 isshown that includes a visual representation 316 of a high resolutionimage media file to which an extended service request form is attached.An instruction block 312, contains information for the service provider80 to follow in the execution of the requested extended service. In thisexample, the user has indicated that the high resolution image mediafile is to be placed for sale which can be one type of extended serviceoffered by service provider 80. The italicized word “BOAT” can be theresult of the user selecting a word from a list or it can be the resultof applying the user's content identifiers to this specific highresolution image media file. Information block 314 includes keywordsthat can be input by the user and useful in the execution of therequested extended service. Other extended services include posting thevisual representation 316 of the high resolution image media file to awebsite that uses such visual representations 316 to aid in the sellingof goods or to aid in the finding of a seller of such goods.

[0087] Another example of an extended service is the use of the highresolution image media file to represent an item insured by a thirdparty such as an insurance business. In the event that an insurancebusiness has been contracted with by the user to insure specifichousehold belongings, high resolution image media files help the userget insurance rates that reflect the actual belongings depicted in thehigh resolution image media file. The user provides specific informationabout the specific household belonging depicted by the high resolutionimage media file such as manufacturer, purchase price, purchase date,serial number and any other information necessary to providing insuranceon such a belonging. Additionally, the user provides authorization toservice provider 80 for the third party insurance business to viewspecific high resolution image media files. Tagging a high resolutionimage media file for adding to an insured item list or deleting from aninsured item list permits an automatic update of insurance coverage andcan result in an added fee or credit applied to the user by the thirdparty insurance business. Service provider 80 can charge a fee from athird party business for permitting the third party business such as aninsurance business to view image media files depicting household objectsbelonging to the user. An additional third party, such as the retailerof the item sold, can be used for validation of ownership and sale ofthe particular item.

[0088] Another example of extended services includes a service performedby a non-professional third party user or peer (a free lance individual)operable in the systems 18, 200 and 300 by the processes shown in FIGS.16 and 18. The process of FIG. 18 describes an example of a detailedprocess used by service provider 80 in step 292 of FIG. 16. In thiscase, the user has provided unlimited third party authorized access to ahigh resolution image media file or group of high resolution image mediafiles on the extended service request form for the purposes of restoringa scanned high resolution image file created from an older, damagedhardcopy print. Information on the extended service request form caninclude an amount of money that requesting user is willing to pay inexchange for the service. In lieu of money, account manager 84 canprovide account credits to the third party providing the service. Theseaccount credits can be used when the third party requests extendedservices from other users. Account manager 84 can also provide accountcredits in the form of loyalty points or reduced account fees.

[0089] Beginning with step 550, service provider 80 retrieves the highresolution image media file from the user computer 10 and stores thehigh resolution image media file in a memory of computer system 86.While this is the preferred embodiment, the retrieval of the highresolution image media file from user computer 10 need not happen untilafter third party user accepts the service request in step 558.Following in step 552, service provider 80 adds the extended servicerequest form including a low resolution image file to a list of servicerequests on a web page whose access and display is managed by web server82 and account manager 84. Third party users access (step 554) the listof extended service request and decide to accept or not accept anextended service request in step 556. Third party users can counteroffer (step 566) to perform the extended service for terms differingfrom what was originally offered. For example, the third party user canraise the required amount of money from that originally offered tocomplete the service. The user requesting the service can choose toaccept (step 568) the revised terms of service or end the negotiation instep 570. If terms agreed upon, the third party user retrieves (step558) the high resolution image file to perform the service on fromeither service provider 80 or directly from the requesting user byaccessing the high resolution image media file on user computer 10.

[0090] The third party user performs (step 560) the extended servicerequested, which in this example is an image restoration, by usingcommonly available tools such as Photoshop™ produced by Adobe SystemsInc. The third party modified high resolution image media file isconverted to a low resolution image file for review by the userrequesting the extended service. If the user requesting the extendedservice accepts (step 562) the work of the third party user, serviceprovider 80 assigns (step 564) credits to the third party user less afee for brokering the service and debits to the user requesting theextended service with the process ending in step 570. Cataloging imagesis another extended service that can be provided by third party users orpeers in this manner.

[0091] Turning now to FIG. 19, a block diagram of an electronic(digital) camera 23 which captures high resolution image files that arestored on the removable memory card 350. FIG. 20 depicts a rear view ofthe electronic camera 23 of FIG. 19. The electronic camera 23 is poweredby rechargeable batteries 344 that connect to power supply 346 whichsupplies power to the camera circuits depicted in FIG. 19. A chargerinput 348 is provided as an external connection (which can be includedas part of interface connection 342) so that the rechargeable batteries344 can be recharged by an external power source. The electronic camera23 includes a zoom lens 352 having zoom and focus motor drives 360 andan adjustable aperture and shutter (not shown). The user composes theimage using the optical viewfinder 341 and the zoom lens control 334 andthen depresses the shutter button 331 to begin capture of a still image.The zoom lens 352 focuses light from a scene (not shown) on an imagesensor 354, for example, a single-chip color CCD image sensor, using thewell-known Bayer color filter pattern. The image sensor 354 iscontrolled by clock drivers 366. The zoom and focus motors 360 and theclock drivers 366 are controlled by control signals supplied by acontrol processor and timing generator circuit 364. The controlprocessor and timing generator circuit 364 receives inputs fromautofocus and auto-exposure detectors 368 and controls a flash 362. Theanalog output signal from the image sensor 354 is amplified andconverted to digital data by the analog signal processing (ASP) andanalog-to-digital (A/D) converter circuit 356. The digital data isstored in a Dynamic Random Access Memory (DRAM) buffer memory 358 andsubsequently processed by a processor 320 controlled by the firmwarestored in the firmware memory 328, which can be flash ErasableProgrammable Read Only Memory (EPROM).

[0092] The processed high resolution image file is provided to a memorycard interface 324 which stores the high resolution image file on theremovable memory card 350. Removable memory cards 350 are one type ofremovable image digital storage medium and are available in severaldifferent physical formats. For example, the removable memory card 350can include memory cards adapted to the Personal Computer Memory CardInternational Association (PCMCIA) card interface standard, as describedin the PC Card Standard, Release 2.0, published by the Personal ComputerMemory Card International Association, Sunnyvale, Calif., September1991. The removable memory card 350 can also be adapted to the CompactFlash interface standard, such as described in the CompactFlashSpecification Version 1.3, published by the CompactFlash Association,Palo Alto, Calif., Aug. 5, 1998, or to the well-known SmartMedia,MemoryStick or SD memory card formats. Other types of removable imagedigital storage media, such as magnetic hard drives, magnetic tape, oroptical disks, can alternatively be used to store the digital images.

[0093] The processor 320 performs color interpolation followed by colorand tone correction, in order to produce rendered sRGB image data. Therendered sRGB image data is then JPEG compressed and stored as a JPEGimage file on the removable memory card 350. The JPEG file uses theso-called “Exif” image format defined in “Digital Still Camera ImageFile Format (Exif)” version 2.1, July 1998 by the Japan ElectronicsIndustries Development Association (JEIDA), Tokyo, Japan. This formatincludes an Exif application segment that stores particular imagemetadata, for example the date and time the picture was captured, thelens f/number and other camera settings and image captions or commentsthat can be selected or entered by the camera user.

[0094] The electronic camera 23 also includes a modem 390 connected toan RF antenna 392. The modem 390 is preferably a cellular modem using,for example CDMA (Code Division Multiple Access) or TDMA (Time DivisionMultiple Access) technologies. The modem 390 communicates withcommunication network 50 via a wide area cellular network, such as the1900 MHz CDMA network deployed by Sprint PCS in the USA.

[0095] An interface connection 342 can be used to connect between aninterface 322 in the electronic camera 23 and a corresponding camerainterface in the user computer 10. The interface connection 342 mayconform to, for example, the well-known universal serial bus (USB)interface specification, or to many other standard interfaces. Theinterface connection 342 can be used to transfer images from removablememory card 350 to the user computer 10. The interface connection 342can also be used to transfer data from the user computer 10 to firmwarememory 328 in electronic camera 23. In particular, it can optionally beused to transfer phone numbers, e-mail addresses, Internet URLs, etc. tofirmware memory 328, as described in commonly-assigned U.S. Ser. No.09/004,046 filed Jan. 7, 1998 entitled “NETWORK CONFIGURATION FILE FORAUTOMATICALLY TRANSMITTING IMAGES FROM AN ELECTRONIC STILL CAMERA” toWard et. al., the disclosure of which is herein incorporated byreference.

[0096] The graphical user interface displayed on the color LCD imagedisplay 332 is controlled by mode control 370 and push buttons 372-376shown in FIG. 19. The user places the mode control 370 in the “capture”position prior to capturing images. The user places the mode control 370in the “review” position in order to review the captured images, deleteundesirable images and transfer images via modem 390, using push buttons372-376. An optional microphone 394, connected control processor andtiming generator circuit 364 via audio codec 396, can be used to receivevoice commands, as described in described in commonly-assigned U.S. Pat.No. 5,737,491 entitled “ELECTRONIC IMAGING SYSTEM CAPABLE OF IMAGECAPTURE, LOCAL WIRELESS TRANSMISSION AND VOICE RECOGNITION” to Allen,et. al., the disclosure of which is herein incorporated by reference.

[0097]FIG. 21 depicts a flow chart of a method of using the electroniccamera 23 in order to transfer high resolution image files captured bythe electronic camera 23 to a user's high resolution image collection,automatically e-mail images to one or more people depicted in thecaptured images and order copies of high resolution image files fromfulfillment provider 70. In step 400, the user registers theirelectronic camera 23 with the service provider 80 and providesinformation such as was described earlier in relation to step 30 of FIG.2. In step 402, the service provider 80 provides a service ID andnetwork configuration information which is stored in the firmware memory328 of electronic camera 23. This can be done when the electronic camera23 is purchased or rented from the service provider 80, as described incommonly-assigned U.S. patent application Ser. No. ______ (Docket80,724P/F-P) entitled “SYSTEM AND METHOD FOR PROVIDING IMAGING PRODUCTSAND SERVICES” to Wolcott, et. al., the disclosure of which is hereinincorporated by reference. This enables the electronic camera 23 toautomatically connect to the communications network 50 via modem 390 inorder to transfer high resolution image files and control information tothe service provider 80.

[0098] In step 404, the user content identifiers described earlier inrelation to FIGS. 9-10 are stored in the firmware memory 328 ofelectronic camera 23. This enables the electronic camera 23 to recognizeuser content present in any captured high resolution image files. Instep 406, the user fulfillment preferences are stored in firmware memory328 of electronic camera 23. These preferences may stored using aservice account information file as described in commonly-assigned U.S.patent application Ser. No. ______ (Docket 81,072/F-P) entitled “METHODFOR PROVIDING CUSTOMIZED PHOTO PRODUCTS OVER A NETWORK” to Parulski, thedisclosure of which is herein incorporated by reference. This serviceaccount information file can be created when the user purchases or rentsthe electronic camera 23, in response to user selections of preferredphoto products, such as service prints, album pages and the like, thatthe user is likely to purchase from the fulfillment provider 70.

[0099] Following step 406, the electronic camera 23 is ready to capturehigh resolution images. In step 408, the user captures a group of highresolution images using the electronic camera 23. The high resolutionimages are processed as described earlier and temporarily stored onmemory card 350. Instep 410, the captured high resolution images areoptionally examined to determine if one or more are recognized asincluding user content, using the user content identifiers provided instep 404. Each user content identifier includes at least one e-mailaddress. In step 412, for each image which has been recognized as havinguser content (e.g. each image including the face of the personcorresponding to image icon 202 in FIG. 10) the images are marked forautomatic transfer to the e-mail address(s) corresponding to therecognized image icon 202. This image marking can be implemented, forexample, by creating a Digital Print Order Format (DPOF) version 1.1“auto transfer” file which includes the e-mail address and the filenames of the images which have been recognized as including the imageicon 202. This auto transfer file is preferably an ASCII text file namedAUTXFER.MRK, in accordance with the DPOF specification.

[0100] In step 414, the user optionally reviews the captured highresolution images and orders photo products, such as enlargements andalbum pages, using the captured high resolution image files. Theswitches 372-376 are used to select high resolution image files to beprinted to produce these photo products and the number of copies to bemade. In step 416, the electronic camera 23 creates an image utilizationfile, as described in commonly-assigned U.S. Ser. No. 09/004,046 filedJan. 7, 1998 entitled “NETWORK CONFIGURATION FILE FOR AUTOMATICALLYTRANSMITTING IMAGES FROM AN ELECTRONIC STILL CAMERA” to Ward et. al.,the disclosure of which is herein incorporated by reference. This imageutilization file is preferably an ASCII text file named AUTOPRNT.MRK, inaccordance with the Digital Print Order Format (DPOF) specification.

[0101] In step 418, the captured high resolution image files and theoptional DPOF auto transfer and print order files are transmitted to theservice provider 80 via modem 390 and are temporarily stored at theservice provider 80. The transmission begins when the electronic camera23 provides an ID that identifies the user account and the instructionsprovided by the user during the registration process. These instructionsnormally include the address of the user's high resolution collection.The instructions can also include default photo product requests, thatcan be used instead of, or in addition to, the DPOF print order file.For example, the instructions can specify that one 4×6 inch print (10.16cm×15.24 cm) of each uploaded image should be produced and mailed to auser specified address. In this case, the DPOF print order file is usedonly when the user wishes to override this “default” instruction.

[0102] In step 420, low resolution copies of each uploaded highresolution image file are added to the low resolution image collectionassociated with the ID provided by the electronic camera 23. These lowresolution copies are normally stored at the service provider 80 so thatthey can be accessed by authorized third parties as described earlier inrelation to step 44 of FIG. 1.

[0103] In step 422, the high resolution image files are transferred fromthe service provider 80 to the user's high resolution image collection(normally located on the user computer 10) as described earlier in step120 of FIG. 6. This transfer can occur during the next routinecommunication interval, or during a non-scheduled communication.

[0104] In step 424, the high resolution image files are e-mailed to thee-mail addresses provided in the DPOF AUTXFER.MRK file described earlierin relation to step 412.

[0105] In step 426, the high resolution image files are transferred fromthe service provider 80 to the fulfillment provider 70, where they areused to produce the default photo products defined in the instructionsprovided by the user in step 400, or in the DPOF AUTPRINT.MRK filedescribed earlier in relation to step 416.

[0106] After the high resolution image files have been transferred, theyno longer need to be stored by the service provider 80. Alternatively,service provider 80 can store the high resolution image files for afixed period of time such as 90 days to facilitate product reordering.After such a fixed period, the high resolution image files are convertedto low resolution image files and added to the user's low resolutioncollection as previously discussed.

[0107] Turning now to FIG. 22, there is shown a flow chart which showsanother method of operation of the system of FIG. 1. In this embodiment,the low resolution images are maintained on user computer 10, ratherthan being provided by the service provider 80. In step 500, the userestablishes an account with the service provider 80 and establishesaccount data flow parameters, as described earlier in reference to step30 of FIG. 2. In step 502, the user identifies an image collection, asdescribed earlier in reference to step 32 of FIG. 2.

[0108] In step 504, a low resolution image database is created on theuser computer 10, so that low resolution images can be provided toauthorized third parties. In step 506, an on-line connection isestablished using CSP 20 and communication network 50, between theuser's home computer 10 and the service provider 80, to indicate thatthe user is now on-line. In step 508, the service provider 80 determineswhich, if any, authorized third parties are currently on-line and wishto view the images in the low resolution image collection of the user.In step 510, the low resolution images are transferred from the usercomputer 10 to the computer 16 of the authorized third party using CSP20, communication network 50 and CSP 22. In step 512, the third partyviews the low resolution images transferred from the user computer 10 onthe third party computer 16. In step 514, the third party requests thehigh resolution version of one or more low resolution images transferredfrom the user computer 10. In step 516, the high resolution images aretransferred from the user computer 10 to the third party computer 16.

[0109] Turning now to FIG. 23, there is shown a flow chart which showsanother method of operation of the system 18 of FIG. 1 or the system 200of FIG. 5. In step 520, an authorized third party views the lowresolution images of a first user. These low resolution images may beprovided by the service provider 80, as described in relation to FIG. 2and FIG. 6, or may be provided from the first user computer 10, asdescribed in relation to FIG. 21. In step 522, the authorized thirdparty selects one or more low resolution images from the first user'scollection, for inclusion in a photo product, such as a photo album or aphoto montage, containing numerous pictures. Such pictures might, forexample, be of the same event attended by the first user, a second userand an authorized third party.

[0110] In step 524, the authorized third party views the low resolutionimages of the second user. Again, these low resolution images may beprovided by the service provider 80, as described in relation to FIG. 2and FIG. 6, or may be provided from the second user's computer, asdescribed in relation to FIG. 21. In step 526, the authorized thirdparty selects one or more low resolution images from the second user'scollection, for inclusion in the same photo product.

[0111] In step 526, the authorized third party places an order with thefulfillment provider 70, via service provider 80, for the photo product,which includes the selected images from the first user's collection andthe second user's collection. In step 528, high resolution versions ofthe images selected by the authorized third party are transferred fromthe first user's high resolution collection to the fulfillment provider70. This may occur immediately if the first user is currently on-line,or at a later time at the next routine communication interval. In step530, high resolution versions of the images selected by the authorizedthird party are transferred from the second user's high resolutioncollection to the fulfillment provider 70. In step 532, the fulfillmentprovider 70 produces and ships the photo product selected by theauthorized third party to the designated address provided by theauthorized third party and bills the authorized third party for thephoto product. In step 534, loyalty points are assigned to the first andsecond users, for providing the digital images which were used in thephoto product.

[0112] The invention has been described in detail with particularreference to certain preferred embodiments thereof, but it will beunderstood that variations and modifications can be effected within thespirit and scope of the invention. PARTS LIST 10 User computer 12Electronic camera 14 Storage drive 15 Kiosk 16 Third party computer 18System 20 Communication service provider (CSP) 22 Communication serviceprovider (CSP) 23 Digital Camera 25 Telecommunications network 30 Step32 Step 34 Step 36 Step 38 Step 40 Step 42 Step 44 Step 46 Step 50Communication network 52 Step 54 Step 56 Step 58 Step 68 Transportationvehicle 70 Fulfillment Provider 72 Web server 74 Commerce manager 75Fulfillment manager 76 Computer system 78 Digital printer 80 Serviceprovider 82 Server 84 Account manager 86 Computer system 88 Regionaldatabase(s) 90 Photofinisher 92 Photographic film 93 Film cartridge 94Film processor 96 Film scanner 98 Memory device 100 Computer 102 Server104 Printer 106 Step 108 Step 110 Unique identification (ID) 112 Step114 Step 116 Step 118 Step 120 Step 122 Step 124 Step 126 Step 128 Step130 Step 132 Step 134 Step 136 Step 138 Step 140 Step 142 Step 144 Step148 Step 149 Step 150 Step 152 Step 154 Step 156 Step 158 Step 160 Step162 Step 166 Step 170 Step 172 Step 174 Step 176 Step 178 Step 180 Step182 Step 184 Step 200 System 202 Image icon 204 Display screen 206 Image228 Step 230 Step 232 Step 234 Step 236 Step 238 Step 240 Step 242 Step244 Step 250 Step 252 Step 254 Step 256 Step 260 Step 262 Step 264 Step266 Step 268 Step 270 Step 272 Step 274 Step 276 Step 280 Step 282 Step284 Step 286 Step 288 Step 290 Step 292 Step 294 Step 300 System 310Screen shot 312 Instruction block 314 Information block 316 Visualrepresentation 320 Processor 322 Interface 324 Memory card interface 328Firmware memory 331 Shutter button 332 LCD image display 334 Zoom lenscontrol 341 Optical viewfinder 342 Interface connection 344 Rechargeablebatteries 346 Power supply 348 Charger unit 350 Removable memory card352 Zoom lens 354 Image sensor 356 Circuit 358 Buffer memory 360 Focusmotors 362 Flash 364 Timing generator circuit 366 Clock drivers 368Auto-exposure detectors 370 Mode control 372 Push buttons/switches 373Push buttons/switches 374 Push buttons/switches 375 Pushbuttons/switches 376 Push buttons/switches 390 Modem 392 RF antenna 394Microphone 396 Audio codec 400 Step 402 Step 404 Step 406 Step 408 Step410 Step 412 Step 414 Step 416 Step 418 Step 420 Step 422 Step 424 Step426 Step 428 Step 500 Step 502 Step 504 Step 506 Step 508 Step 510 Step512 Step 514 Step 516 Step 520 Step 522 Step 524 Step 526 Step 528 Step530 Step 532 Step 534 Step 550 Step 552 Step 554 Step 556 Step 558 Step560 Step 562 Step 564 Step 566 Step 568 Step 570 Step

What is claimed is:
 1. A system for managing digital images, comprising:a server for allowing controlled access to a user image storage devicehaving at least one digital image file of an image, said server having acommunication system capable of communicating with a plurality of usercomputers, at least one of said user computers having said at least onedigital image file, a software program for controlling access to said atleast one digital image file, said software program for permittingautomatic access to said at least one digital image file on said usercomputer by a third party and monitoring access by said third partywithout any further authorization by said user.
 2. A system according toclaim 1 wherein said at least one digital image file includes anelectronic address for identifying that image came from said user.
 3. Asystem according to claim 1 wherein said third party pays an access feefor use and/or down loading of said image from said user image file. 4.A system according to claim 3 wherein said service provider assigns afirst predetermined credit to the account of the user of said downloadedimage, a debit to the account of the third party downloading the image,and a second predetermined credit to the service provider.
 5. A systemaccording to claim 1 wherein a report is provided to said user regardingaccess to said digital media file.
 6. A computer software product formanaging digital images stored on a user computer, said software productcomprising a computer readable storage medium having a computer programwhich when loaded into said user computer causes the computer to performthe following steps of: allowing controlled access by a service providerto said digital image files stored on said user computer, said providerhaving a communication system capable of communicating with a pluralityof different devices, said software program using an electronic datafile for permitting automatic access to said at least one digital imagefile by a third party and monitoring access by said third party withoutany further authorization by said user.
 7. A method for monitoringaccess to digital image files on a user computer by third parties over acommunication network by service provider, comprising the steps of:allowing controlled access by third parties to said digital image fileson said user computer; monitoring access by said third parties to saiddigital image files; reporting said access by said third parties to saiduser.
 8. The method according to claim 7 wherein said third party paysan access fee for use and/or down loading of said digital image filefrom said user.
 9. A system according to claim 8 wherein said serviceprovider assigns a first predetermined credit to the account of the userof said downloaded image, a debit to the account of the thirddownloading the image, and a second predetermined credit to the serviceprovider.
 10. A system according to claim 1 wherein a report is providedto said user regarding access to said digital media file.
 11. A systemfor managing digital images, comprising: a server for allowingcontrolled access to a user image storage device having at least onedigital image file of an image, said server having a communicationsystem capable of communicating with a plurality of user computers, atleast one of said user computers having said at least one digital imagefile, a software program for controlling access to said at least onedigital image file, said software program for permitting automaticaccess to said at least one digital image file by a third party andmonitoring access by said third party without any further authorizationby said user.
 12. A system according to claim 11 wherein said digitalimage file is stored on a service provider computer and is accessed bysaid third party on said computer.
 13. A system according to claim 11wherein said at least one digital image file includes an electronicaddress for identifying that image came from said user.
 14. A systemaccording to claim 11 wherein said third party pays an access fee foruse and/or down loading of said image from said user image file.
 15. Asystem according to claim 11 wherein said service provider assigns afirst predetermined credit to the account of the user, a debit to theaccount of the third party downloading the image, and a secondpredetermined credit to the service provider.
 16. A system according toclaim 11 wherein a report is provided to said user regarding access tosaid digital media file.